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(54) Arrangement for increasing the comprehension of speech when translating speech from a first 
language to a second language. 



(57) The invention relates to an arrangement for 
improved speech comprehension in artificial 
translation of one language to a second lan- 
guage. The arrangement comprises an analysis 
unit which carries out an analysis of duration 
and fundamental tone of the speech in the first 
language. A prosody-interpreting unit deter- 
mines, on the basis of the analysis and lan- 
guage-characteristic information, prosody-depen- 
dent information in the first speech which 
is used by a prosody-generating unit for the 
second language for controlling the speech 
synthesis. A speech synthesis element thus 
produces stresses in the speech translated 
in the second language which, from a language 
point of view, correspond to stresses in the first 
language. 
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FIELD OF THE INVENTION 

The invention relates to an arrangement for in- 
creasing the comprehension of speech when translat- 
ing speech from a first language to a second lan- 
guage. The invention is intended to be used in equip- 
ment which artificially tranlates speech in one lan- 
guage into verbal information in a second language. 
The aim of the invention is to achieve an improvement 
in the possibilities of creating a translation corre- 
sponding to the original speech by means of artificial 
translation. 

PRIOR ART 

Devices for speech synthesis and translation are 
already known. EP 327 408 and US 4 852 1 70 relate 
to systems for language translation. The systems 
comprise speech recognition and speech synthesis. 
However, the systems do not utilize prosody interpre- 
tation and prosody generation. 

EP 0 095 1 39 and EPO 139419 describe speech 
synthesis arrangements which utilize prosody infor- 
mation. These documents, however, do not describe 
the utilization of prosody information in language 
translation. 

One problem with the earlier technique is that it 
does not take stresses into account in translating 
from one language to another. The present invention 
solves the problem by using prosody-interpreting and 
prosody-generating units. 

SUMMARY OF THE INVENTION 

The present invention thus provides an arrange- 
ment for increasing the comprehension of speech 
when translating speech from a first language to a 
second language. The arrangement comprises ele- 
ments for receiving speech in a first language, a 
translation unit for translating the speech in the first 
language to a second language, and speech synthe- 
sis elements for generating speech in the second lan- 
guage. 

According to the invention, the arrangement also 
comprises an analysis unit which analyzes variations 
in the fundamental tone and duration of the speech in 
the first language, and a prosody- interpreting unit 
which determines first prosody-dependent informa- 
tion in dependence on the said analysis and on lan- 
guage-characteristic information which relates to the 
first language. A prosody-generating unit generates 
second prosody-dependent information with starting 
point from the first prosody-dependent information 
and from the language-characteristic information 
which relates to the second language. The second 
prosody-dependent information is used by the 
speech synthesis element for producing stresses in 
the second language corresponding to stresses in the 



speech in the first language. 

Embodiments of the invention are specified in 
the subsequent Patent Claims. 

5 BRIEF DESCRIPTION OF THE DRAWING 

The invention will now be described in detail with 
reference to the attached drawing, in which the single 
figure is a block diagram of a preferred embodiment 
w of the invention. 

DETAILED DESCRIPTION OF PREFERRED 
EMBODIMENTS 

15 Figure 1 shows a block diagram of an embodi- 

ment of the present invention. The arrangement pro- 
duces a translation from speech in language 1 to 
speech in language 2. The arrangement comprises in 
known manner a speech recognition unit which pre- 

20 ferably converts the received speech into text. A 
translation unit converts the text, also in a manner 
which is known per se, into text in a desired second 
language. The text in language 2 is converted into 
speech in a text/speech converting element. 

25 The novelty in the present invention is, however, 

that the prosody, that is to say information on sound 
characteristics in sound combinations, in the input 
speech is utilized in the synthesis of the translated 
speech. The arrangement therefore comprises an 

30 analysis unit which carries out an analysis of the fun- 
damental tone and duration of the sound combina- 
tions included in the speech. The analysis is supplied 
to a prosody- interpreting unit which assembles pro- 
sody-dependent information about the input speech, 

35 here called the first prosody-dependent information. 
This also utilizes information on language character- 
istics of the first language. These language character- 
istics are stored in advance in the prosody-interpret- 
ing unit. 

40 The first prosody-dependent information is util- 

ized by the translation unit but also by a prosody-gen- 
erating unit which is characteristic of the present in- 
vention. The prosody-generating unit generates sec- 
ond prosody-dependent information which is supplied 

45 to the text-to-speech converting element. This ele- 
ment utilizes the second prosody-dependent informa- 
tion for producing stresses, that is to say fundamental 
tone and durations, which, from a language point of 
view, correspond to the stresses in the input speech 

so in the first language. The translation, that is to say the 
speech in language 2, is thus given a prosody which 
corresponds to the prosody in the speech in language 
1 which is to be translated. By this means, an en- 
hanced comprehension of speech is achieved. 

55 The scope of the invention is limited only by the 

Patent Claims below. 
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Claims 

1. Arrangement for increasing the comprehension 
of speech when translating speech from a first 
language to a second language, comprising 5 

elements for receiving speech in a first 
language, a translation unit for translating 
speech in the first language to a second lan- 
guage, and speech synthesis elements for gen- 
erating speech in the second language, charac- 10 
terized in that the arrangement also comprises 

an analysis unit which analyzes variations 
in the fundamental tone and duration of the 
speech in the first language, 

a prosody- interpreting unit which determi- 15 
nes first prosody-dependent information in de- 
pendence on the said analysis and on language- 
characteristic information which relates to the 
first language, 

a prosody-generating unit which gener- 20 
ates second prosody-dependent information with 
a starting point from the first prosody-dependent 
information and from language-characteristic in- 
formation which relates to the second language, 
which second prosody-dependent information is 25 
used by the speech synthesis element for produc- 
ing stresses in the second language correspond- 
ing to stresses in the speech in the first language. 

2. Arrangement according to Claim 1 , characterized 30 
in that the receiving element comprises a speech 
recognition element which converts the first 
speech into text, the translation unit translating 

text in the first language into text in the second 
language, and in that the speech synthesis ele- 35 
ment comprises a text-to-speech converting ele- 
ment. 
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